Sensory remapping: a possible therapy option / Remapeamento sensorial: uma possível opção de terapia

The human sensory receptors are morphologically specialized to transduce specific stimuli into the brain. However, when an injury occurs, mainly in the spinal cord, which can be of traumatic or non-traumatic origin, it provokes various degrees of sensory deficits, autonomic, motor and sphincter dysfunction below the level of the injury. Based on this, a new therapeutic modality is being proposed by neuroscientist Miguel Nicolelis, which is based on the brain-machine interface, that is, using other pathways so that the information can reach the cerebral cortex and thus be consciously processed (AU).

Os receptores sensoriais humanos são morfologicamente especializados para realizar a transdução de estímulos específicos para o encéfalo. Entretanto, quando ocorre uma lesão, principalmente, na medula espinal, que pode ser de origem traumática e não traumática, provocam diversos graus de déficits sensoriais, disfunção autônoma, motora e esfincteriana, abaixo do nível da lesão. Com base nisso, uma nova modalidade terapêutica está sendo proposto pelo neurocientista Miguel Nicolelis, que tem como base a interface cérebro máquina, isto é, utilizar-se de outras vias para que as informações possam chegar no córtex cerebral e assim serem processadas conscientemente.Palavras-chave: Interfaces cérebro-computador, Neurociências, Órgãos dos sentidos (AU).

Roadmap of Medical Device for Implanted Brain-computer Interface / 中国医疗器械杂志

Implanted brain-computer interface (iBCI) is a system that establishes a direct communication channel between human brain and computer or an external devices by implanted neural electrode. Because of the good functional extensibility, iBCI devices as a platform technology have the potential to bring benefit to people with nervous system disease and progress rapidly from fundamental neuroscience discoveries to translational applications and market access. In this report, the industrialization process of implanted neural regulation medical devices is reviewed, and the translational pathway of iBCI in clinical application is proposed. However, the Food and Drug Administration (FDA) regulations and guidances for iBCI were expounded as a breakthrough medical device. Furthermore, several iBCI products in the process of applying for medical device registration certificate were briefly introduced and compared recently. Due to the complexity of iBCI in clinical application, the translational applications and industrialization of iBCI as a medical device need the closely cooperation between regulatory departments, companies, universities, institutes and hospitals in the future.

The research status and development trends of brain-computer interfaces in medicine / 生物医学工程学杂志

Brain-computer interfaces (BCIs) have become one of the cutting-edge technologies in the world, and have been mainly applicated in medicine. In this article, we sorted out the development history and important scenarios of BCIs in medical application, analyzed the research progress, technology development, clinical transformation and product market through qualitative and quantitative analysis, and looked forward to the future trends. The results showed that the research hotspots included the processing and interpretation of electroencephalogram (EEG) signals, the development and application of machine learning algorithms, and the detection and treatment of neurological diseases. The technological key points included hardware development such as new electrodes, software development such as algorithms for EEG signal processing, and various medical applications such as rehabilitation and training in stroke patients. Currently, several invasive and non-invasive BCIs are in research. The R&D level of BCIs in China and the United State is leading the world, and have approved a number of non-invasive BCIs. In the future, BCIs will be applied to a wider range of medical fields. Related products will develop shift from a single mode to a combined mode. EEG signal acquisition devices will be miniaturized and wireless. The information flow and interaction between brain and machine will give birth to brain-machine fusion intelligence. Last but not least, the safety and ethical issues of BCIs will be taken seriously, and the relevant regulations and standards will be further improved.

Research on phase modulation to enhance the feature of high-frequency steady-state asymmetric visual evoked potentials / 生物医学工程学杂志

High-frequency steady-state asymmetric visual evoked potential (SSaVEP) provides a new paradigm for designing comfortable and practical brain-computer interface (BCI) systems. However, due to the weak amplitude and strong noise of high-frequency signals, it is of great significance to study how to enhance their signal features. In this study, a 30 Hz high-frequency visual stimulus was used, and the peripheral visual field was equally divided into eight annular sectors. Eight kinds of annular sector pairs were selected based on the mapping relationship of visual space onto the primary visual cortex (V1), and three phases (in-phase[0º, 0º], anti-phase [0º, 180º], and anti-phase [180º, 0º]) were designed for each annular sector pair to explore response intensity and signal-to-noise ratio under phase modulation. A total of 8 healthy subjects were recruited in the experiment. The results showed that three annular sector pairs exhibited significant differences in SSaVEP features under phase modulation at 30 Hz high-frequency stimulation. And the spatial feature analysis showed that the two types of features of the annular sector pair in the lower visual field were significantly higher than those in the upper visual field. This study further used the filter bank and ensemble task-related component analysis to calculate the classification accuracy of annular sector pairs under three-phase modulations, and the average accuracy was up to 91.5%, which proved that the phase-modulated SSaVEP features could be used to encode high- frequency SSaVEP. In summary, the results of this study provide new ideas for enhancing the features of high-frequency SSaVEP signals and expanding the instruction set of the traditional steady state visual evoked potential paradigm.

Ethics considerations on brain-computer interface technology / 生物医学工程学杂志

The development and potential application of brain-computer interface (BCI) technology is closely related to the human brain, so that the ethical regulation of BCI has become an important issue attracting the consideration of society. Existing literatures have discussed the ethical norms of BCI technology from the perspectives of non-BCI developers and scientific ethics, while few discussions have been launched from the perspective of BCI developers. Therefore, there is a great need to study and discuss the ethical norms of BCI technology from the perspective of BCI developers. In this paper, we present the user-centered and non-harmful BCI technology ethics, and then discuss and look forward on them. This paper argues that human beings can cope with the ethical issues arising from BCI technology, and as BCI technology develops, its ethical norms will be improved continuously. It is expected that this paper can provide thoughts and references for the formulation of ethical norms related to BCI technology.

Advances in brain-computer interface based on high-frequency steady-state visual evoked potential / 生物医学工程学杂志

Steady-state visual evoked potential (SSVEP) has been widely used in the research of brain-computer interface (BCI) system in recent years. The advantages of SSVEP-BCI system include high classification accuracy, fast information transform rate and strong anti-interference ability. Most of the traditional researches induce SSVEP responses in low and middle frequency bands as control signals. However, SSVEP in this frequency band may cause visual fatigue and even induce epilepsy in subjects. In contrast, high-frequency SSVEP-BCI provides a more comfortable and natural interaction despite its lower amplitude and weaker response. Therefore, it has been widely concerned by researchers in recent years. This paper summarized and analyzed the related research of high-frequency SSVEP-BCI in the past ten years from the aspects of paradigm and algorithm. Finally, the application prospect and development direction of high-frequency SSVEP were discussed and prospected.

Research on the feature representation of motor imagery electroencephalogram signal based on individual adaptation / 生物医学工程学杂志

Aiming at the problem of low recognition accuracy of motor imagery electroencephalogram signal due to individual differences of subjects, an individual adaptive feature representation method of motor imagery electroencephalogram signal is proposed in this paper. Firstly, based on the individual differences and signal characteristics in different frequency bands, an adaptive channel selection method based on expansive relevant features with label F (ReliefF) was proposed. By extracting five time-frequency domain observation features of each frequency band signal, ReliefF algorithm was employed to evaluate the effectiveness of the frequency band signal in each channel, and then the corresponding signal channel was selected for each frequency band. Secondly, a feature representation method of common space pattern (CSP) based on fast correlation-based filter (FCBF) was proposed (CSP-FCBF). The features of electroencephalogram signal were extracted by CSP, and the best feature sets were obtained by using FCBF to optimize the features, so as to realize the effective state representation of motor imagery electroencephalogram signal. Finally, support vector machine (SVM) was adopted as a classifier to realize identification. Experimental results show that the proposed method in this research can effectively represent the states of motor imagery electroencephalogram signal, with an average identification accuracy of (83.0±5.5)% for four types of states, which is 6.6% higher than the traditional CSP feature representation method. The research results obtained in the feature representation of motor imagery electroencephalogram signal lay the foundation for the realization of adaptive electroencephalogram signal decoding and its application.

Automatic removal algorithm of electrooculographic artifacts in non-invasive brain-computer interface based on independent component analysis / 生物医学工程学杂志

The non-invasive brain-computer interface (BCI) has gradually become a hot spot of current research, and it has been applied in many fields such as mental disorder detection and physiological monitoring. However, the electroencephalography (EEG) signals required by the non-invasive BCI can be easily contaminated by electrooculographic (EOG) artifacts, which seriously affects the analysis of EEG signals. Therefore, this paper proposed an improved independent component analysis method combined with a frequency filter, which automatically recognizes artifact components based on the correlation coefficient and kurtosis dual threshold. In this method, the frequency difference between EOG and EEG was used to remove the EOG information in the artifact component through frequency filter, so as to retain more EEG information. The experimental results on the public datasets and our laboratory data showed that the method in this paper could effectively improve the effect of EOG artifact removal and improve the loss of EEG information, which is helpful for the promotion of non-invasive BCI.

Multi-task motor imagery electroencephalogram classification based on adaptive time-frequency common spatial pattern combined with convolutional neural network / 生物医学工程学杂志

The effective classification of multi-task motor imagery electroencephalogram (EEG) is helpful to achieve accurate multi-dimensional human-computer interaction, and the high frequency domain specificity between subjects can improve the classification accuracy and robustness. Therefore, this paper proposed a multi-task EEG signal classification method based on adaptive time-frequency common spatial pattern (CSP) combined with convolutional neural network (CNN). The characteristics of subjects' personalized rhythm were extracted by adaptive spectrum awareness, and the spatial characteristics were calculated by using the one-versus-rest CSP, and then the composite time-domain characteristics were characterized to construct the spatial-temporal frequency multi-level fusion features. Finally, the CNN was used to perform high-precision and high-robust four-task classification. The algorithm in this paper was verified by the self-test dataset containing 10 subjects (33 ± 3 years old, inexperienced) and the dataset of the 4th 2018 Brain-Computer Interface Competition (BCI competition Ⅳ-2a). The average accuracy of the proposed algorithm for the four-task classification reached 93.96% and 84.04%, respectively. Compared with other advanced algorithms, the average classification accuracy of the proposed algorithm was significantly improved, and the accuracy range error between subjects was significantly reduced in the public dataset. The results show that the proposed algorithm has good performance in multi-task classification, and can effectively improve the classification accuracy and robustness.

From Parametric Representation to Dynamical System: Shifting Views of the Motor Cortex in Motor Control / 神经科学通报·英文版

In contrast to traditional representational perspectives in which the motor cortex is involved in motor control via neuronal preference for kinetics and kinematics, a dynamical system perspective emerging in the last decade views the motor cortex as a dynamical machine that generates motor commands by autonomous temporal evolution. In this review, we first look back at the history of the representational and dynamical perspectives and discuss their explanatory power and controversy from both empirical and computational points of view. Here, we aim to reconcile the above perspectives, and evaluate their theoretical impact, future direction, and potential applications in brain-machine interfaces.

Motor imagery electroencephalogram classification based on sparse spatiotemporal decomposition and channel attention / 生物医学工程学杂志

Motor imagery electroencephalogram (EEG) signals are non-stationary time series with a low signal-to-noise ratio. Therefore, the single-channel EEG analysis method is difficult to effectively describe the interaction characteristics between multi-channel signals. This paper proposed a deep learning network model based on the multi-channel attention mechanism. First, we performed time-frequency sparse decomposition on the pre-processed data, which enhanced the difference of time-frequency characteristics of EEG signals. Then we used the attention module to map the data in time and space so that the model could make full use of the data characteristics of different channels of EEG signals. Finally, the improved time-convolution network (TCN) was used for feature fusion and classification. The BCI competition IV-2a data set was used to verify the proposed algorithm. The experimental results showed that the proposed algorithm could effectively improve the classification accuracy of motor imagination EEG signals, which achieved an average accuracy of 83.03% for 9 subjects. Compared with the existing methods, the classification accuracy of EEG signals was improved. With the enhanced difference features between different motor imagery EEG data, the proposed method is important for the study of improving classifier performance.

A review of researches on decoding algorithms of steady-state visual evoked potentials / 生物医学工程学杂志

Brain-computer interface (BCI) systems based on steady-state visual evoked potential (SSVEP) have become one of the major paradigms in BCI research due to their high signal-to-noise ratio and short training time required by users. Fast and accurate decoding of SSVEP features is a crucial step in SSVEP-BCI research. However, the current researches lack a systematic overview of SSVEP decoding algorithms and analyses of the connections and differences between them, so it is difficult for researchers to choose the optimum algorithm under different situations. To address this problem, this paper focuses on the progress of SSVEP decoding algorithms in recent years and divides them into two categories-trained and non-trained-based on whether training data are needed. This paper also explains the fundamental theories and application scopes of decoding algorithms such as canonical correlation analysis (CCA), task-related component analysis (TRCA) and the extended algorithms, concludes the commonly used strategies for processing decoding algorithms, and discusses the challenges and opportunities in this field in the end.

Applications, industrial transformation and commercial value of brain-computer interface technology / 生物医学工程学杂志

Brain-computer interface (BCI) is a revolutionary human-computer interaction technology, which includes both BCI that can output instructions directly from the brain to external devices or machines without relying on the peripheral nerve and muscle system, and BCI that bypasses the peripheral nerve and muscle system and inputs electrical, magnetic, acoustic and optical stimuli or neural feedback directly to the brain from external devices or machines. With the development of BCI technology, it has potential application not only in medical field, but also in non-medical fields, such as education, military, finance, entertainment, smart home and so on. At present, there is little literature on the relevant application of BCI technology, the current situation of BCI industrialization at home and abroad and its commercial value. Therefore, this paper expounds and discusses the above contents, which are expected to provide valuable information for the public and organizations, BCI researchers, BCI industry translators and salespeople, and improve the cognitive level of BCI technology, further promote the application and industrial transformation of BCI technology and enhance the commercial value of BCI, so as to serve mankind better.

Key technologies for intelligent brain-computer interaction based on magnetoencephalography / 生物医学工程学杂志

Brain-computer interaction (BCI) is a transformative human-computer interaction, which aims to bypass the peripheral nerve and muscle system and directly convert the perception, imagery or thinking activities of cranial nerves into actions for further improving the quality of human life. Magnetoencephalogram (MEG) measures the magnetic field generated by the electrical activity of neurons. It has the unique advantages of non-contact measurement, high temporal and spatial resolution, and convenient preparation. It is a new BCI driving signal. MEG-BCI research has important brain science significance and potential application value. So far, few documents have elaborated the key technical issues involved in MEG-BCI. Therefore, this paper focuses on the key technologies of MEG-BCI, and details the signal acquisition technology involved in the practical MEG-BCI system, the design of the MEG-BCI experimental paradigm, the MEG signal analysis and decoding key technology, MEG-BCI neurofeedback technology and its intelligent method. Finally, this paper also discusses the existing problems and future development trends of MEG-BCI. It is hoped that this paper will provide more useful ideas for MEG-BCI innovation research.

Progresses and prospects on frequency recognition methods for steady-state visual evoked potential / 生物医学工程学杂志

Steady-state visual evoked potential (SSVEP) is one of the commonly used control signals in brain-computer interface (BCI) systems. The SSVEP-based BCI has the advantages of high information transmission rate and short training time, which has become an important branch of BCI research field. In this review paper, the main progress on frequency recognition algorithm for SSVEP in past five years are summarized from three aspects, i.e., unsupervised learning algorithms, supervised learning algorithms and deep learning algorithms. Finally, some frontier topics and potential directions are explored.

A spatial-temporal hybrid feature extraction method for rapid serial visual presentation of electroencephalogram signals / 生物医学工程学杂志

Rapid serial visual presentation-brain computer interface (RSVP-BCI) is the most popular technology in the early discover task based on human brain. This algorithm can obtain the rapid perception of the environment by human brain. Decoding brain state based on single-trial of multichannel electroencephalogram (EEG) recording remains a challenge due to the low signal-to-noise ratio (SNR) and nonstationary. To solve the problem of low classification accuracy of single-trial in RSVP-BCI, this paper presents a new feature extraction algorithm which uses principal component analysis (PCA) and common spatial pattern (CSP) algorithm separately in spatial domain and time domain, creating a spatial-temporal hybrid CSP-PCA (STHCP) algorithm. By maximizing the discrimination distance between target and non-target, the feature dimensionality was reduced effectively. The area under the curve (AUC) of STHCP algorithm is higher than that of the three benchmark algorithms (SWFP, CSP and PCA) by 17.9%, 22.2% and 29.2%, respectively. STHCP algorithm provides a new method for target detection.

Parameter transfer learning based on shallow visual geometry group network and its application in motor imagery classification / 生物医学工程学杂志

Transfer learning is provided with potential research value and application prospect in motor imagery electroencephalography (MI-EEG)-based brain-computer interface (BCI) rehabilitation system, and the source domain classification model and transfer strategy are the two important aspects that directly affect the performance and transfer efficiency of the target domain model. Therefore, we propose a parameter transfer learning method based on shallow visual geometry group network (PTL-sVGG). First, Pearson correlation coefficient is used to screen the subjects of the source domain, and the short-time Fourier transform is performed on the MI-EEG data of each selected subject to acquire the time-frequency spectrogram images (TFSI). Then, the architecture of VGG-16 is simplified and the block design is carried out, and the modified sVGG model is pre-trained with TFSI of source domain. Furthermore, a block-based frozen-fine-tuning transfer strategy is designed to quickly find and freeze the block with the greatest contribution to sVGG model, and the remaining blocks are fine-tuned by using TFSI of target subjects to obtain the target domain classification model. Extensive experiments are conducted based on public MI-EEG datasets, the average recognition rate and Kappa value of PTL-sVGG are 94.9% and 0.898, respectively. The results show that the subjects' optimization is beneficial to improve the model performance in source domain, and the block-based transfer strategy can enhance the transfer efficiency, realizing the rapid and effective transfer of model parameters across subjects on the datasets with different number of channels. It is beneficial to reduce the calibration time of BCI system, which promote the application of BCI technology in rehabilitation engineering.

Robotic arm control system based on augmented reality brain-computer interface and computer vision / 生物医学工程学杂志

Brain-computer interface (BCI) has great potential to replace lost upper limb function. Thus, there has been great interest in the development of BCI-controlled robotic arm. However, few studies have attempted to use noninvasive electroencephalography (EEG)-based BCI to achieve high-level control of a robotic arm. In this paper, a high-level control architecture combining augmented reality (AR) BCI and computer vision was designed to control a robotic arm for performing a pick and place task. A steady-state visual evoked potential (SSVEP)-based BCI paradigm was adopted to realize the BCI system. Microsoft's HoloLens was used to build an AR environment and served as the visual stimulator for eliciting SSVEPs. The proposed AR-BCI was used to select the objects that need to be operated by the robotic arm. The computer vision was responsible for providing the location, color and shape information of the objects. According to the outputs of the AR-BCI and computer vision, the robotic arm could autonomously pick the object and place it to specific location. Online results of 11 healthy subjects showed that the average classification accuracy of the proposed system was 91.41%. These results verified the feasibility of combing AR, BCI and computer vision to control a robotic arm, and are expected to provide new ideas for innovative robotic arm control approaches.

Classification algorithms of error-related potentials in brain-computer interface / 生物医学工程学杂志

Error self-detection based on error-related potentials (ErrP) is promising to improve the practicability of brain-computer interface systems. But the single trial recognition of ErrP is still a challenge that hinters the development of this technology. To assess the performance of different algorithms on decoding ErrP, this paper test four kinds of linear discriminant analysis algorithms, two kinds of support vector machines, logistic regression, and discriminative canonical pattern matching (DCPM) on two open accessed datasets. All algorithms were evaluated by their classification accuracies and their generalization ability on different sizes of training sets. The study results show that DCPM has the best performance. This study shows a comprehensive comparison of different algorithms on ErrP classification, which could give guidance for the selection of ErrP algorithm.

Cross-subject electroencephalogram emotion recognition based on maximum classifier discrepancy / 生物医学工程学杂志

Affective brain-computer interfaces (aBCIs) has important application value in the field of human-computer interaction. Electroencephalogram (EEG) has been widely concerned in the field of emotion recognition due to its advantages in time resolution, reliability and accuracy. However, the non-stationary characteristics and individual differences of EEG limit the generalization of emotion recognition model in different time and different subjects. In this paper, in order to realize the recognition of emotional states across different subjects and sessions, we proposed a new domain adaptation method, the maximum classifier difference for domain adversarial neural networks (MCD_DA). By establishing a neural network emotion recognition model, the shallow feature extractor was used to resist the domain classifier and the emotion classifier, respectively, so that the feature extractor could produce domain invariant expression, and train the decision boundary of classifier learning task specificity while realizing approximate joint distribution adaptation. The experimental results showed that the average classification accuracy of this method was 88.33% compared with 58.23% of the traditional general classifier. It improves the generalization ability of emotion brain-computer interface in practical application, and provides a new method for aBCIs to be used in practice.